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[57] ABSTRACT 
A video signal, compression system includes motion 
compensated predictive compression apparatus for 
compressing respective frames of video signal accord- 
ing to either intraframe processing or interframe pro- 
cessing on a block by block basis to generate blocks of 
compressed data and associated motion vectors. A com- 
pressed signal formatter arranges - the blocks of com- 
pressed data and the associated motion vectors accord- 
ing to a desired signal protocol wherein monon vectors 
of interframe processed frames are associated with cor- 
responding blocks of compressed data and motion vec- 
tors of intraframe processed frames are associated with 
blocks substantiaUy adjacent to corresponding blocks of 
compressed data. The motion vectors are included with 
intraframe compressed data to facilitate error conceal- 
ment at respective receiver apparatus. 
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, , predictive frames. As with intraframe coded frames the 

xv;. w I ... SUN and ZEDEPSKI in US. patent application Ser 

This invenoon relates to apparatus for providing 5 No. 08/017.455 filed Feb. 12. 1993 and entitled APPA^ 

concealment of lost or corrupted video data in compres- RATUS FOR CONCEALTNrr F^? RHP^ m a nr/r 

sion systems using an MPEG-like signal protocol." T^S?S?£'sSS?Si^^^^^^ 

BACKGROUND OF THE INVENTION entirety herein by reference) describe a method of 

When referring to MPEG-lilce signal what is meant is 10 "^""^^AZVr.! T^T" '^^''^ T w^'^ 
a comprised video signal of the general hieraichic^ s^ii f ^„li^^ ^ system the MPEG-lilce 
form established by thTMPEG Video Committee for ?f If arranged m transport packets for transmission. 
International Organization for Standard to 7^' ^^^^^ P""^? "^"^^.^ error codes for detecting 

MPEG-like video compression cyclically provides [^.''' corniption of r^pective packets. Sun and Zdep- 
fields/frames of data compressed by either in^a&^l 15 f^f^^^ ^'^^ ^or concealmg the effects of the 
techniques or mtcrframc predictive techniques. Refer to transport packets on reproduced images. These 

FIG. 1 which shows a pictorial representation of the P'"^*^*^ "^^^"^^ providmg substitute compressed data 
MPEG-Uke coding format The frame sequence is f °^ providing substitute decompressed data depen- 
mereiy representative. The leners I. P. and B above compressed data lost or cor- 

respective frames indicate the coding mode for the 20 ^^J^\ Error concealment techniques set forth by Sun 
respective frame. The frame sequence is divided into ^ ^epski, mclude the substitution collocated blocks 
groups of frames (GOF) each of which includes the ° ^^^^P'^^ data, substitution of non-coUocated 
same coding sequence. Each frame of coded data is decompressed data derived from motion vec- 

divided into sUccs representing, for example, 16 image vertically adjacent macroblocks and the use 

lines. Each slice is divided into macroblocks each of 25 !^°^°^?"^^tors from vertically adjacent macroblocks 
which represents, for example, a 16x16 matrix of pix- forming substitute compressed data for a lost macrob- 
els. Each macroblock consists of, for example, 6 blocks °^ interframe compressed data, 

including four blocks of information relating to lumi- Intraframe compressed data tends to be of greater 
aanee signal and two blocks of information relating to importance than the interframe compressed data in 
chrominance signal. The luminance and chrominance 30 reproducing compressed images because all frames in a 
information are coded separately and then combined for S^o^P of frames depend from or build on the decom- 
transmission. The luminance blocks include data relat- pressed intraframe data. Ironically error concealment of 
ing to respective S X 8 matrices of pixels. Each chromi- intraframes is least effective because there is less variety 
nance block comprises an 8 X 8 matrix of data relating to encoded data from which to select substitute data. In 
the entire 16x16 matrix of pixels represented by the 35 Particular, there are no motion vectors included within 
macroblock. the intraframe coded information. As a result, substirate 

Blocks of data, encoded according to intraframe cod- blocks of interframe data are substantially relegated to 
ing a frames), consist of matrices of Discrete Cosine ^^ing either an average gray value or collocated blocks 
Coefficients. That is. respective 8x8 blocks of pixels ^^om a prior frame or interpolated blocks. If the blocks 
are subjected to a Discrete Cosine Transform (DCT) to 40 collocated, moving image objects will create image 
provide coded signal. The coefficients are subjected to artifacts, alternatively if the substitute blocks are inter- 
adaptive quantization, and then are run-length and van- polatcd, these areas will suffer loss of detail, 
able-length encoded. Hence respective blocks of trans- ct rx^ii^ . o ,r ^r- 

mitted data may include fewer than an 8x 8 matrix of SUMMARY OF THE INVENTION 

codewords. Macroblocks of intraframe encoded data, 45 The present invention is an MPEG-like compression 
wiU mclude. m addition to the DCT coefficients, infor- system including apparatus for compressing respective 
mation such as the level of quantization employed, a frames according to intraframe and interframe compres- 
macroblock address or location indicator, and a mac- «on processes. Interframe compression apparatus is 
roblock type utilized to generate motion vectors for intraframe com- 

blocks of data, encoded according to P or B inter- 50 pressed frames. The intrafi^e compressed data Is ar- 
framc coding also consist ofmatrices of Discrete Cosine ranged in blocks or macroblocks and the intraframe 
Coefficients. In this instance however the coefficients motion vectors associated with respective blocks or 
differences between a predic- macroblocks are included in the coded signal of vcrti- 
tedSXS piJ^l matrix and the actual 8x8 pbtcl matrix, cally adjacent blocks or macroblocks for transmission 
These coefficients are subjected to quantization and 55 At the receiving end of such system, respective mo^ 
run- and vanable-length coding. In the frame sequence uon vectors contained in the coded blocks or macrob- 
L^l e fi^^^STiated anchor frames. Each P locks of the intraframe compressed data are extracted 

frame is predicted from the lastmost occurring anchor and stored. When blocks or macroblocks associated 
frame. Each B frame is predicted from one or both of with such motion vectors are subsequently received or 
the anchor frames between which it is disposed. The 60 should have been received and have been determined to 
predicuve codmg process mvolves generating displace- be lost or corrupted and uncorrectabu"the^SiS 
mcnt vectors which indicate which block of an anchor motion vectors ^e accessed from storag; aidX^IJ 
frame most closely matches the block of the predicted generate substitute data for the lost or fo^m^^^^^^ 
frame currently being coded. The pixel dau of the or macroblocks. "le losi or corruptea DiocJcs 

matched block in the anchor frame is subtracted, on a 65 

pixcl-by-pixcl basis, from the block of the frame being BRIEF DESCRIPTION OF THE DRAWINGS 
encoded to develop the residues. The tnmstormcd resi- FIG. I is a pictorial representation of sienal layers of 
dues and the vectors comprise the coded data for the an MPEG-like compressed^d^ .i^^ ^ 
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FIG. 2 IS a block diagram of apparatus for compress- best match to blocks in the current frame. These motion 

mg video signal to .provide a compressed video signal vectors are applied to the formatter 25 wherein they are 

according to an MPEG-like protocol. associated with their corresponding macroblocks in the 

PIC. 3 IS a pictorial representation of an MPEG-like MPEG-like code sequence. That is, each interframe 
compressed video signal code sequence. 3 coded macroblock of residue transform coefncients has 

FIG. 4 is a pictorial representation of a transport a motion vector associated therewith to indicate to 

packet utilized for transmitting MPEG-like data. decoding apparatus the raster location which the de- 

HG. SIS a block diagram of a portion of an MPEG- coded macroblock values should represent In Ae 

like signal decompressor including error concealment MPEG-like systems, as noted before, motion vecton 
apparatus. 10 are only generated for interframe compressed frames of 

DETAILED DESCRIPTION vidso signal, and the motion vector generator 18 need 

not operate during incraframe compression. 

Apparatus for generating MPEG-likc signal is shown In the present system however, the motion vector 

m FIG. 2. MPEG-hkc processing apparatus nominally generator is operated during intraframe compression to 
includes separate apparatus (at least in part) for com- 15 generate motion vectors for respective macroblocks of 

pressing luminance and chrominance signal compo- I frames to aid in error concealment processes at respec- 

nents. The luminanee component compression appara- tive receivers. The motion vector generator may oper- 

tus IS shown m the figure. However it is assumed that ate for I frames in the same manner it operates for P 

the formatter 25 receives compressed chrominance frames for example. The motion vectors generated for 
data, from parallel curuitry not shown, in order to 20 macroblocks of such I frames indicate macroblocks in a 

create macroblocks ofboth luminance and chrominance prior decoded anchor frame, stored for example in 

compressed data. Smce this type of apparatus is gener- memory of the motion compensated predictor, which 

aUy known to those skilled in the art of video signal most closely matches each respective macroblock 

''°™Pi'!^'°"' ^ description will be provided. However in this application of the motion vectors the 

In FIG. 2, a video signal source 10 provides video 25 motion vectors are not coded within the macroblocks 

signal to be compressed to one input of a subtraction for which they were generated. Rather they are in 

circuit 11, and to a motion vector generator 18. Signal eluded within macroblocks which have a low probabil- 

from a motion compensated predictor including ele- ity of being lost or corrupted if the macroblock which it 

ments 17 and 16, is applied to a second input of the represents is lost or corrupted. Assume that horizon- 
subtraction circuit During mtraframe compression The 30 tally adjacent macroblocks are included in the same 

predictor Provides a zero value to the subtraction cir- transport packets, but vertically adjacent macroblocks 

cmt 11, and during interfiame compression the predic- are not. Hence, if a particular macrtjblock is lost, the 

tor provodes values representing a prediction of the probability that a horizontally adjacent neighbor wiU 

current frame bemg compressed. Hence during intra- also be lost will be much higher than the probability 

frame compression the subtraction circuit 11 provides 35 that a verticaUy adjacent macroblock will also be lost 

pixel valu«, and dnnng mterirame compression it pro- In this instance the motion vectors representinR resoec- 

vides the differences between the pixel values of the tive macroblocks are coded within thdr vertic^ly adia- 

current frame and the predicted frame, i.e.. it provides cent macroblocks. This is illustrated pictorially in the 

residues. .^^^ ^ ^ . . expanded portion of the "FRAME i" in FIG. 1. Thus If 

The values provided by the subtraction circuit 11 are 40 a particular macroblock is lost in transmission, there is a 

provided to a duicrete cosme transform. DCT. circuit high probability that its associated motion vector wiU 

•12. which transforms the spatial doraam signal to the survive and may be utilized to aid in error concealment 
frequency domain. Coefficients generated by the DCT The motion vectors generated for I hsn^^ ^^. 

r.hSc'l'^ quantizmg apparatus 13 which effec- plied to the formatter 25 for inclusion with the rcmaln- 

dvely hmits the dynamic rangeof respective ones of the 45 ing macroblock data. However since motion vector of 

coefficienc. The quantized coefficients are then run slice n are included with macroblockX ofTe vert- 

f^^ "P"'"^ * ^' "^^^ n- 1 must be delayed one slice interval. This delay is 

arranges the signal components accordmg to the desired provided by the compensating delay element 23 In 

signal protocol e.g. the MPEG-like protocol. Note 50 FIG. 2, macroblock da^ is applied to the forl^f; 5 

provision may be included to DPCM encode certain of via a multiplexer 24 either dir^tly from Uie ™Slh 

the signal components such as Ae DC DCT coefficients and variable encoder 22 or through the com^SI 

and/or motion vectors. The MPEG-like signal is ap- delay 23. The multiplexer is conditioned to eS^f 

plied to a transport processor wherem It IS conditioned direct connection during compassion of P and B 

SL^^'^'^'r ^^'^^ "^^ " ''"^^ conn^tion through .he com^a^ 

Sh'^ ' ^' " ^ """^^ delay during compression of I frames. Actuary the 

sIZl ^on, ,r"^ 'or tnmsm«sion or storage. compensating delay 23 and multiplexer 24 includ^ in 

coSh^ti^Hf^^ ? " '^^^^ ^ '^"'^ - ^ ^"'y TT>c formatter 25 marslulb 

SS^S which^™ l''"^^^' 'V"** ^ '"r""* ^S^iRcam amounts of data which arrives sporadic^ly 

per 15, which respecuvelyperf^onn the mverse func- 60 and thus reauires storage memory to raake^espective 

uons o elements 13 and 12. The pixel values or residues types of data concurrently available Tr apTrSe 

generated by the inverse DCT are applied to the motion sequencing. To effect the one slice delay of the macrob^ 

don of'Trf ' H 7"'."' "'""'T ' ''^'^ '° P"'" ' ^--^ motion vectors of sli« n 

'^^^^ in«o macroblocks of slice n - 1 merely requires incr^as- 

frame data irom the predictor 16, 17, and current frame ter 25 o / 

Jr.ntJv hln^tfoT?K ^ ^rr'" "^^t^ '^^ MPEG-like coded signal format is illustrated in 

Identify blocks of the predicted frame which are the FIG. 3. The MPEG hierarchical format includes a plu- 
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rality of layers each with rcspecn ve header information. The macroblocic pointer is used for segmented macrob- 
Nonunally each header includes a start code, data re- lock or record header components, and points to the 
lated to the respective layer and provision for adding start of the next decodable component For example, if 
header extensions. The header information is required the particular transpon packet includes macroblock 
for synchronization purposes in an MPEG systems en- 5 data associated with the end of slice n and the beginnins 
"KE?™*"'- of slice n + 1. the data from slice a is placed adjacent the 

The coded output signal of the present system is transport header and the pointer indicates that the next 
segmented in groups of fields/frames (GOF) illustrated decodable data is adjacent the transport header TH. 
by the row of boxes L2 (FIG. 3). Each GOF (U) b- Conversely, if a record header RH is adjacent the TH 
eludes a header followed by segments of picture data. 10 the first pointer indicates the byte position foUowinathe 
The GOF header mcludes data related to the horizontal record header RH. A zero valued macroblock pokter 
and veracal picture size, the aspect ratio, the field/- indicates that the transport packet has no macrSblock 
frame rate, the bit rate, etc. entry point. 

TTie picture data (L3) corresponding to respective The transport packet may include none, one or more 
fields/frames mcludes a header followed by slice data 15 than one record header. A record header occurs at the 
(U). The picture header includes a field/frame number beginning of each slice of macroblock data. No rxword 
and a picture code type. Each slice (L4) includes a headers are included in transport blocks that include 
had» followed by a plurality of blocks of data MBi. only video data header information. The record header 
The slice header includes a group number and a quaati- (RH) pomter points to the byte position containing the 
zanon parameter 20 start of the first record header in the transpon packet A 

Each block MBi (LS) represents a macroblock and zero valued RH pointer indicates that there are no re- 
mcludes a header foUowed by moUon vectors and cord headers in the transport packet If both the record 
coded coefficients. The MBi headers include a macrob- header pointer and the macroblock pointer are zero 
lock address, a macroblock type and a quantization valued, this state indicates that the transport oadcet 
parameter. The coded cocfRaents arc iUustrated in 25 includes only video data header information 
layer L6. Note each macroblock is comprised of 6 The 18-bit identifier in the LP transport header iden- 
blocks, mc luding four luminance blocks, one U chromi- tifies the current frame type, the frame number (modulo 
nance block and one V chrominance block. 32), the current slice number, and the first macroblock 

The block coefficients are provided one block at a contained in the transport packet 
time with the DCT, DCcoefficient occurring first fol- 30 Following the transport header is either a record 
lowed by respective DCT AC coefficients in the order header. RR or data. As indicated in FIG. 4 the record 
of their reUuve imporumce. An end of block code EOB header for the video data includes the foUowing infor- 
w ^^^^ff at the end of each successively occurring mation: A 1-bit FLAG which indicates if a heiler cx- 
blodcofdata. tension, EXTEND, is present. FoUowing the FLAG b 

■nie compressed video data form the formatter 25 is 35 an identifier rDENTTTY. which indicates a) the field/- 
fif processor 26 which a) segments frame type I. B or P; b) a field/frame number (modulo 
the MPEG-ldce data into respecave payload blocks b) 32) FRAME ID; and c) a slice number (modulo «) 
«tracts portions of the header mformation to form SLICE IDENTITY. Following die identifier the re- 
ttanspoit packet headers, c) concatenates the payload cord header includes a macroblock priority break point 
blocks and the transpon packet headers to form inter- « indicator, PBP. The PBP indicates ie codeword 
mediate transport packets, d) performs a parity or cyclic developed by the analyzer IS2 of the priority selector' 
nslundan.^ check on each mtennediate transport for dividing the codewords between high and staS 
packet and appends the appropriate parity check bits priority channels (when used). Lastly, an optional 
thereto to form respective transport packets, and c) may header extension may be included in the HP rem^ 
multiplex transport packets ofassociated auxiliary data 45 header 

with the transport packets of video data. The parity Each transport packet is terminated with a 164,it 
check bits are utUized by the receiver for isolating er- frame check s^ueAce. FCS, which is cajTuW 
rors m conjunction wtth synchromzing header infonna- aU bits in the transport pack,k The FCS nTv tes<^ 
uon and for providmg error concealment in the event of ated using a cvcUc redundancy code. ' 

""??r*?J? "*"i?'^,'"'^'ff''"**^^ ^° A more detkiled description of exemplary transport ' 

FIG. 4 dlustrates the fonnai of the signal provided by processing apparatus may be found in U S S C 

the transport processor. Respective transpon packets 5,122,875 ' 
may include more or tes than a slice of data. Thus a The transpon packets of infomiation are applied to a 

''^tf^.T'^'l^'f^f'^l^^''^^^'^PV^ ''^^^ «""<l«g ^^^^ which arSrfom 

end of one shce and data from the beginning of the next 53 REED SOLOMON forward error correction «c<^ 

aibscquent slice. Transport packets including video ing; b) interleave blocks of data to preclude t^ge eiror 

data may be mterleaved with transpon packets contain- bursts from comipting a large contiguoilT^ o7a 

mg other data, e.g.. audio. Each transport packet in- reproduced image; and c) app^d^ e g ^^e?^s to 

eludes a service type header ST which indicates the the data for ^^chrorJ^i^^l^^J^lrtTZ 

type of mfonnation mcluded m the respective transport 60 ceiver 

packet. In this example the ST header is an 8-bit word At a receiver the tnmsmitted or stored compressed 

which .ndi«t^ whether the data is high or standard signal is detected, passed through a REED SOLOfS 

P,rh r«n7„«« -,..1, . • . .i . . transport processor 100. The data is applied to a 

T^t,^ Vff^ ""^'u"*" ^ " one packet delay element SO and to an error dewctorSZ 

TH unmediately foUowing the service header. The The enor detator is responsive to^eFrS prror X^^ 

transpon header includes a 7-bit macroblock pointer, an within resDe«^ve tr^r „l.w-f. 7f ^ 

.8.bit identifier and a 7.bit record header (r5) poin'ter. wh^^^r^en^^rs S th^etlloUoMON 
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error correction, and if so to generate an error indica- in one (forward) or both (forward and backward) of the 

don E which is coupled to one input of a demultiplexer buffer memories 314 and 316. The predictor provides a 

56. The delay element compensates for the time re- block of data (from the one of the buffer memories) or 

quired to perform this error check. The delayed trans- an interpolated block of dau (derived from respective 

port packet is applied to a second input of the demuld- 5 blocks from both buffer memories) to a second input of 

plexer 56 and to a service detector 54. The service de- the adder 312. 

lector examines the service code in the transport header Decompression is performed as follows. If a field/- 

to determine whether the transport packet is of the type frame of input video data is iniraframe encoded the 

to be serviced by the respective receiver, and if so what motion vectors associated with respective raacroblocks 

type of data the payload contains. Responsive to the 10 are stored in the memory 66 for use by the error token 

service information the service detector generates a generator 65, and the decoded or inverse transformed 

service control signal S to condition the demuldplexcr OCT coefficients which correspond to blocks of pixel 

to route the data and error signal to the appropriate values arc applied to the inverse DCT element 310 via 

decoder e.g., audio (not shown), video, etc. the decoder 308. For intraframc encoded data the pre- 

The video data provided by the demultiplexer 56 is 15 dictor 304 applies a zero value to the adder 312 and the 

applied to an element 58 which is responsive to the inverse transformed DCT coefficients are passed unai- 

error signal to excise transport packets containing er- tered by the adder 312, to the video display RAM 

rors that were not corrected by the REED SOLOMON where they are stored for readout according to normal 

error correction. Transport packets which contain no raster scanning. The decoded pixel values are also 

errors are separated into transport header data and the 20 stored in one of the buffer memories 314 and 316 for use 

transport packet payload. The payload (DATA) is cou- in forming predicted image values for decoding motion 

pled to a variable length decoder VLD 64. The trans- compensated frames (B or P). 

port header data is arranged for utilization by an error If a field/frame of input data corresponds to a for- 
token generator 65, the system controller 370 and/or ward motion compensated P field/frame, the inverse 
VLD 64 . For the most part, the MPEG-Ukc data is 25 transformed coefficients correspond to residues or dif- 
variable length encoded and thus a variable length de- fcrenccs between the present field/frame and the last- 
coder is required to decode the video data. Variable most occurring I frame. The predictor 304, responsive 
length decoders are well known and are essentially state to the decoded motion vectors accesses the correspond- 
machines which route variable length codewords to ing block of I frame data stored in either buffer memory 
different ones of a plurality of decoding tables. The 30 314 or 316 and provides this block of data to the adder 
particular table used for a particular codeword is depen- wherein respective blocks of residues provided by the 
dent upon the type of data the codeword represents. inverse DCT circuit 310 are added to the corresponding 
Nominally, in an error free environment, a VLD will block of pixel data provided by the predictor 304. The 
obtain all necessary data to perform decoding from the sums generated by the adder 312 correspond to the pixel 
input data stream. However when segments of data are 35 values for the respective blocks of the P field/frame, 
lost, such a VLD may lock up or take an inordinate time which pixel values are applied to the display RAM 318 
to resynchronizc. The transport header data is applied to update respective storage locations. In addition the 
to the VLD 64 along with the error signal, such that the pixel values provided by the adder 312 are stored in the 
VLD state machine is reset to the appropriate decoding one of buffer memories 314 and 316 not storing the I 
state on the resumption of good data. Alternatively, 40 field/frame of pixel data utilized to generate the pre- 
after loss of data the state of the VLD may be re-estab- dieted pixel data. 

.lished by control signals from the system controller 370 For bidirectionally encoded (B) field/frames the op- 

in response to transport header and error data. eration is similar, except predicted values are accessed 

In an error free environment, variable length de- from the stored anchor frames (I or P) in both buffer 

coded signal from the VLD are applied to the system 45 memories 314 and 316 depending upon whether the 

controller and decompression controller 360 which respective motion vectors are forward or backward 

extract the MPEG-like header data to control the over- vectors or both. The generated B field/frame pixel 

all decoding sequencing. The variable length decoded values are applied to update the display RAM 318, but 

codewords corresponding to DCT coefficients are ex- arc not stored in cither of the buffer memories, as B 

tracted and applied to a decoder 308 and the variable 50 field/frame data is not utilized for generating other 

length decoded codewords corresponding to motion field/frames of picture data. 

vectors are applied to the decoder 306. The decoder 308 The MPEG-iike signal fonnat allows the encoding of 

contains apparatus for performing inverse run length some macroblocks to be skipped. For macroblocks that 

decoding and inverse DPCM coding as appropriate are skipped, the decoder effectively copies them from 

under the control of the controller 360. Decoded data 55 the previous picture into the present picture, or aitema- 

from the decoder 308 are applied to an inverse DCT tively, for skipped macroblocks the corresponding areas 

circuit 310 which mcludes circuitry to inverse quantize of the video display RAM 318 simply are not updated, 

the respective DCT coefficients and to convert the Macroblock skipping may be accomplished by coding 

coefficients to a matrix of pixel data. The pixel data is the motion vectors with zero values and the DCT coef- 

then coupled to one input of an adder 312, the output of 60 ficients with all zero values. This feature of the decoder 

which is coupled to the video display RAM 318 and may be utilized to effect error concealment for lost 

buffer memories 314 and 316. macroblocks. simply by synthesizing the appropriate 

The decoder 306 includes circuitry to perform in- compressed codewords for skipped macroblocks on the 

verse DPCM coding of the motion vectors as appropri- occurrence of lost macroblocks. 

ate under the control of the controller 360. Decoded 65 Next, let us consider an environment in which errors 

motion vectors are applied to a motion compensated occur and transport packets are excised from the data 

predictor 304. Responsive to the motion vectors the stream applied to the VLD. Error concealment is the 

predictor accesses corresponding blocks of pixels stored responsibility of the error token generator 65. The error 



07/26/2002, EAST Version: 1.03.0002 



5.442,400 

token generator is, for example, a microprocessor Alternatively substitute data may comprise the mac- 
wmch IS programmed to respond to the header infonna- roWock address, the macroblock type. DC DCT coeffi. 
noamclml«i m the transport blocks, the state of the cients con«ponding to a midgray value for respective 
VLD and w the aror indicanons. The error token blocks in the mactoblocks and EOB codes for rapec- 
graerator 65 may mclude a table of substitute data 5 tive blocks in the macioblock. In this instance the corc- 
which simubtes compressed video data. This data cor- sponding image area will be reproduced with a midgray 
responds to pamcular data that is recognizable by the brightness value. 

MPEG-like decomptasor The error token generator is Availability of motion vectors in the P and B frames 
also provided with data from the memory 66 which provides added flexibility. Substitute macroblock* in 
may be substimted for excised video data. In particular. 10 compressed form may be composed of motion vectors 

Irf ij''"'?'^ i*: '"Pons'^f w state sequencer of the stored in the memory 66 and selected from vertically 

VLD, IS load(rf with motion vectors corresponding to, adjacent macroblocks, and an indication that the cur- 

for examp e, the motion vectors of macroblocks in the rent macroblock was not coded, which means that aU of 

previous shce of data. the residue values are considered to be zero valued. In 

The mouon of image objects will occur across mac- IS this instance the area of the image corresponding to the 

roblock boundaries. In addition errors will propagate or lost macroblock wiU likely be moving in synchronism 

occur along the horuonol direction. Thus it is likely with the remainder of the image, however the actual 

that motion vectors for P and B encoded frames from picture detail of this area may be slightly in error 
vertically adjacent tnacroblocks wiU be similar, and the Consider that the DC DCT coeffidene of respective 

substitution of motion vectors from vertically adjacent 20 blocks may be differentially encoded (DCPN© from 

macroblocks will result in acceptable error conceal- macroblock to macroblock. In this case the last macrob- 

mmt. The motion vectors from vertically adjacent mac- lock of a sequence of substitute macroblocks will not 

roblocks of I encoded frames are precisely the requisite have a correct DC DCT value for the first non subsri- 
ffr^Vr^K^** T macroblock to reference. The error token gcnera- 

I frame macroblocks. Sunilaxly the DC DCT coefBci- 2S tor may include facility to substitute a DC DCT coefTi- 

ents from vemcaUy adjacent blocks can be expected to cient in such last substitute macroblocks from a verti- 

be sraular. As sw:h they may abo be stored in the mem- cally adjacent macroblock (i.e., taken from memory 66) 

ory 66 for subsntuuon of lost DC coefficients. or from a temporally displaced collocated macroWocfc 

Storage of data in the memory 66 is controUed by the (taken from an expanded memory 66 arranged to store 

state sequencer withm the VLD. The sequencer is prtv 30 select compressed data for e.g. an entire frLe) 
grammed to condition the VLD to output data accord- Providing substitute data for I frames may be done in 

mg to a predetermined sequence, and thus can provide simUar fashion, however since I frames are anchors for 

the appropriate sig^ls to fetch the desired types of data an entire group of frames, substitute data should be in 

wi^ in'to'lT' ™!. '^T '^^ compressed form so that the results are reflecS^in th^ 

wntten into the memory at predetermined address loca- 35 prediction data stored in the memories 314 316 Also 

tions which may be accessed by the error token genera- note that compressed I frame data comprises pixel' value 
"tka .,,1,- . u coefficients, not residue coefficients, and in nor- 

The error token generator momtors the transport mal operation, when I frame data is being decoded the 

^ determine when and motion compensated predictor is nominaUy conditioned 

what data is lost, and responsive to lost daui, substitiites 40 to provides a zero value to the adder 312. Thus if a 

^^J'LlcTJ °f P'"'"'^^- substitute I frame macroblock is formed of a motion 

mmed types of daa are preprogrammed for substitution vector and zero valued coefTicients. without more the 

dependmg on the frame type and the type of data that is invenie DCT dement 310 and thrpredictor W bSh 

losL For example, macroblocks carry particular ad- will provide zero values to the add JsS S thesuS?- 

dresses and occur m a predetermined sequence. The 45 tute macroblock with the resdrti^t Je r«^u«l 

determmes if thwe is a break m the normal sequence of overriding the normal decompression algorithm v^ the 
macroblocks and provides substitute macroblocks for control bus interconnecting L error toteawn^tor 
missmg macroblocks. The substitute data may be in the with the predictor. On the subsnt^on of an*?^e 
^°^°J^y?9'^'^'^P^^<^t^''"^i^<=hcaseitis SO macroblock with a synthesized macroblock includine 
substituted mto the compressed data stream by the mul- compressed verrically'^jacent motion vecton^d z^r^ 
tiplexer 67 m place of the lost macroblock. or the subsri- valued coeffidents or EOB coS tiie m^^T DCT 
tute data may be in the form of. for example spatially element wiU pass zero vah^ but thrprSr S^l 
collocated temporally delayed image datii. in which conditioned by the error token gen^at^to oaiTthe 
«« « IS provided by sunple management of the display 55 predicted image values seleLd by SiTmotiin v^to^ 

tok^nT^irt^f r b"'^ -T'^'^^^ — ^^^^"^'^^''^^tr,^^^^ 

currentiybemgprocKsed and where in aie data stream 60 correct since residues were ^Tinduded to pS 

the error occurred. The smiplest form of substitute data correction to the prediction vduej howcv « f™! 

may cons« sunply of datt md.ca.ing that a particuhir images of low to moderate de^the rLdts wilT be 

macroblock was not coded. Th« data is substituted in substantially exact and in general confori^y wiA o«J 

compressed form with the result that the decompression motion. B«:"«ai conronnity witn local 

algoritiim will replace the corresponding image area 65 Further adjuncts to error concealment may be oro- 

with coUocated data from the previous frame. In actual- vided bv the error token -enera^TdS Fo^^ 

.ty the decompression process simply does not update reviewof someof thSjfnc«TreadefL nvif^ to 

the correspondmg image area in the display RAM 318. consult U.S. patent application Ser No S7o 7«? 
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What is claimed is: 

1. Apparatus for compressing video data comprising: 

a source of video signaJ to be compressed; 

motion compensated predictive compression means 
for compressing respective frames of said video 
signaJ according to either intraframc processing or 
interflame processing and on a block by block basis 
to generate blocks of compressed data correspond- 
ing to respective image areas, said motion compen- 



12 



carded by said means for detecting errors, said 
synthesized data formed using intraframe motion 
vectors corresponding to said discarded blocks, 
which said motion vectors are accessed from said 
memory; and 
means for substituting said blocks of synthesized data 
for corresponding said discarded blocks of intra- 
frame compressed data. 
5. The apparatus set forth in claim 4 wherein said 



sated predictive compression means including 10 decompression means includes: 



means for providing interframe modon vectors 
NfV/for blocks B/ of both intraframe and interflame 
processed video signal, said motion vectors MV, 
relating respective blocks of predicted video signal 
to blocks of original video signal which are sub- 15 
stantially similar; and 
formatting means for arranging said blocks of com- 
pressed data and associated said motion vectors 
according to a desired signal protocol, wherein 
said interframe motion vectors NfV| for blocks B/of 20 
said interframe processed video signal are attached 
to blocks Bi of interframe compressed data to 
which they relate and said interframe motion vec- 
tors MV/for blocks B/of said intraframe processed 
video signal are attached to blocks Bjt of intraframe 25 
compressed data different than blocks B/ of intra- 
frame compressed data to which the respective 
interframe motion vectors relate, where index k is 
not equal to index i. 

2. The apparatus set forth in claim 1 wherein said 30 
motion vectors corresponding to respective said intra- 
framc processed blocks are attached to vertically adja- 
cent blocks of compressed data. 

3. The apparatus set forth in claim 1 wherein said 
motion compensated compression means includes 35 
means for providing blocks of transformed pixel values 
for said intraframe processed video signal and for pro- 
viding blocks of transformed residues for said inter- 



inverse transform mcaiK having an input port cou- 
pled to receive said blocks of compressed data, and 
having an output port for providing blocks of in- 
verse transformed data; 
an adder having a first input pon coupled to the 
output port of said inverse transform means, having 
an output port at which decompressed signal 5 
available and having a second input pon; 
a motion compensated predictive decompressor cou- 
pled to the output pon of said adder and responsive 
to said decompressed signal and said motion vec- 
tors for generating at an output port of said motion 
compensated predictive decompressor, blocks of 
data corresponding to predicted frames of said 
video signal; and 
means for coupling the output of said motion com- 
pensated predictive decompressor to the second 
input pon of said adder when said interframe pro- 
cessed data is being decompressed^ and for nor- 
mally applying a zero value to the second input 
pon of said adder when said intraframe processed 
data is being decompressed, and for concurrenUy 
coupling said motion compensated :predictive 
decompressor to the second input pon of said 
adder and applying a zero value to the first input 
port of said adder to provide decompressed data 
for discarded blocks of intraframe data.; 
6. Apparatus for processing motion compensated 



frame , processed video signal, wherein said residues compressed video dati whercin^on'^ of fra^i^feiTfvTd^ 

correspond to respecuve differences between predicted 40 sign^ are compressed accoT^ng tolntraS Jr^^ 

pixel values and ongmal pixel values. ing and other fL.es of said vid^ JST^om'^^ 

V^Lt^T H P^^"^S ™ compensated according to interframe processing^rwhereinT^ 

oDmpressed video dau wherem ones of frames of video intraframe and interframe processing generate^^^^^ 

mg and other frames ofsaid video signal are compressed 45 motion vectors MV- ^ Tc ^"^^ 

accordmg to interframe processit,rand wher^ said tTveTJl^ofTntS^";^^ 

intraframe and mtenrame processing generates com- motion vector*: MV f respective 
pr«^ data ot, a block b/blo^ and wh^I ^r^^Z^.o^^^ 

motion vectors are generated for respective blocks of to which they resoecdvelv con-™^ « h 

mtraframe processed data, and respective motion vec- 50 comprising '"^^'''"'^^ correspond, sa.d apparatus 



55 



tors of intraframe processed blocks are attached to 
blocks of data other than blocks to which they respec- 
tively correspond, said apparatus comprising: 
a source of said motion compensated compressed 
video data; 

means for detecting errors in said motion compen- 
sated compressed video data and for discarding 
blocks of data including errors; 

means for separating said morion vectors from re- 
spective blocks of intraframe compressed data, and 60 
for storing said motion vectors in memory, and for 
applying blocks of intraframe compressed data 
without corresponding intraframe motion vectors 
to decompression means for decompression; 

means, responsive to said motion compensated com- 65 
pressed video data and said means for detecting 
errors, for providing blocks of synthesized data for 
said blocks cf intraframe compressed data dis- 



motion compensated compressed 



a source of said 
video data; 

means for detecting errors in said motion compen- 
sated compressed video data and for discarding 
blocks of data including errors; 

means for separating motion vectors. MV^^^^y^^^ 
from said respective blocks of intraframe com- 
pressed data, for storing said motion vectors, MV,^, 
imframt, in memor>', and for normally applying 
blocks of intraframe compressed data, without said 
motion vectors. MV,>,„/>c„^ to decompression 
means for decompression; 

means, responsive to said means for detecting errors, 
and stored motion vectors, ViV imrafrcrr,^ in said 
memory, for generating substitute blocks of image 
data for discarded blocks of intraframc comoresscd 
data. 
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